Structural phase transition in evolving networks 
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A network as a substrate for dynamic processes may have its own dynamics. We propose a 
model for networks which evolve together with diffusing particles through a coupled dynamics, and 
investigate emerging structural property. The model consists of an undirected weighted network of 
fixed mean degree and randomly diffusing particles of fixed density. The weight w of an edge increases 
by the amount of traffics through its connecting nodes or decreases by a constant factor. Edges are 
removed with the probability Pre™. = 1/(1 +w) and replaced by new ones having ui = at random 
locations. We find that the model exhibits a structural phase transition between the homogeneous 
phase characterized by an exponentially decaying degree distribution and the heterogeneous phase 
characterized by the presence of hubs. The hubs emerge as a consequence of a positive feedback 
between the particle and the edge dynamics. 
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Complex networks have been the subject of extensive 
researches for the last decade. They have a heterogeneous 
structure, which makes them distinct from the periodic 
lattice and the random network. Researches have been 
focused on characterizing the structure and reveahng the 
mechanism leading to it [H, H, H, 0] ■ Some complex net- 
works play the role of a substrate on which dynamic pro- 
cesses, either equilibrium or nonequilibrium, take place. 
Implication of the structural heterogeneity on the dy- 
namic processes has also attracted a lot of interests Q . 

In most studies dynamics of a network itself and addi- 
tional degrees of freedom on it are treated separately. 
These approaches are meaningful when characteristic 
time scales associated with each of them are completely 
separated. When they are comparable, one needs to con- 
sider the dynamics of both kinds of degrees of freedom 
simultaneously. Along these lines, dynamic models for a 
social network coupled with a game-theoretical dynamics 
or an opinion dynamics were studied in Refs. j?!. la. lol [loj . 

The coupled dynamics was also studied in a dynamic 
model for a transportation or an information network by 
the present authors in Ref. [ll|- This study was moti- 
vated by the synaptic plasticity in neural networks p^ . 
Synaptic links in a neural network may strengthen or 
weaken depending on synaptic activities, which results 
in a plastic deformation of a network. In the model [ll[ , 
particles diffuse over a network and edges are rewired at 
the rate depending on particle flows in such a way that 
edges contributing more to transport are more robust. 
It was found that the coupled dynamics leads to an in- 
stability toward the formation of a hub. Although the 
model is useful in studying the dynamical origin for the 
emergence of a hub, it lacks a parameter with which one 
can control the strength of the instability. 

In this paper we consider a model as an extension of the 
study in Ref. 11]. The model consists of an undirected 
weighted network and diffusing particles. There are N 
nodes with the mean degree (fc) and particles with the 
density p. An edge e is assigned to a weight We > 0, 
and a node can accommodate multiple particles. The 



edges, weights, and particles evolve in time as follows: 
At each time step, every particle hops independently to 
a neighboring node selected at random. Whenever a node 
is reached by a particle, the weight of all edges attached 
to it is increased by unity. Then, with the probability 
Prew. — 1/(1 + '"^e), each edge e is removed and replaced 
by a new one with w = between a pair of nodes selected 
randomly. As a regularization procedure, the weight of 
all edges are degraded by the factor r, i.e., We — > {l—r)we 
for all e. 

This model allows one to study the emerging property 
of a complex network evolving through a coupled dynam- 
ics with a transport system. For simplicity, we adopt the 
system of noninteracting random walkers as a transport 
system. Each edge is assigned to the weight which mea- 
sures the amount of traffics handled by connecting nodes. 
The random walkers move along edges, while edges are 
rewired at the rate which is a decreasing function of the 
weight. That is to say, the more contribution to the traf- 
fic an edge makes, the more robust it is. 

When the degradation factor r is zero, the model re- 
duces to the one studied in Ref. [11]. It was shown that 
the coupled dynamics between the edges and particles 
leads to an instability toward the formation of a hub. 
Interestingly, the hub emerges in the two distinct ways. 
When the particle density is low, the hub appears sponta- 
neously after overcoming a dynamic barrier via statistical 
fiuctuations. On the other hand, when the particle den- 
sity is high, nodes compete for edges and one of them 
survive as a hub eventually. In the original model the 
weight of an edge can increase indefinitely, which may 
not be the case when an edge loses its strength due to 
e.g. ageing. The current model incorporates such an 
effect by introducing the degradation factor r. We will 
show that the model with the degradation factor exhibits 
richer behaviors. 

The degradation factor r limits the growth of the edge 
weight. Hence the model can have a stationary state with 
nonzero values of r. Furthermore, there may be a phase 
transition. When r is large, one expects that edges are 



2 




FIG. 1: Time evolution of the degree distribution at r = 0.20 
(a), 0.055 (b), and 0.01 (c). The network size is iV = 10^ and 
the particle density is p = 1.0. Each data set is obtained by 
averaging over Ns ~ 10"^ samples. The dashed line in (b) has 
a slope —4.3. 

rewired at so high rates that the network remains like a 
random network without any hub. In the opposite case 
with small r, edges attached to a certain node may be- 
come robust by gaining larger weights. Such a node can 
grow into a hub as in the case with r = 0. Practically, we 
define the hub as a node whose degree scales algebraically 
with the total number of nodes. 

We have performed numerical Monte Carlo simulations 
in order to examine whether there is a transition be- 
tween the states with and without hubs. We present 
detailed results of numerical simulation studies. Initially 
we start with a random network over which particles 
are distributed randomly. The mean degree is fixed to 
(k) = 4. Then we study the time evolution and the sta- 
tionary state property of the system. 

The degree distribution has been measured as one 
varies r with fixed p = 1, which is presented in Fig. [T] 
The degree distribution function P{k) is defined as the 
fraction of nodes having k edges. At r = 0.2, the degree 
distribution in the stationary state aligns along a straight 
line in the semi-log plot (see Fig. [IJa)). This means that 
the degree distribution follows an exponential decay as 
P{k) ~ Q-^/f'o _ observe a distinct feature at r = 0.01. 
While the degree distribution decays at small values of fc, 
there appears a peak in the large k region. We will show 
later that both the number of nodes contributing to the 
peak and the degree of them scale algebraically with the 
network size N , respectively. Namely, the peak signals 
the emergence of multiple hubs. In the intermediate case 
with r = 0.055, the degree distribution follows a power 
law 

P{k) ~ k-'^ (1) 

with the exponent 7 ~ 4.3. 

Numerical data presented in Fig. [T] show that the 
model undergoes a structural phase transition between 
the stationary states with and without hubs. Such phases 
will be denoted as a heterogeneous phase and a homoge- 
neous phase, respectively. The transition point can be 
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FIG. 2: Plots of the effective exponent 7e//(fc) for the degree 
distribution of networks with A'^ = 1000 and p = 1.0. 

estimated accurately from the effective exponent defined 
as 

7e//(fc) = -ln[P(afc)/P(fc)]/lna (2) 

with a constant a — 2. As a function of A:, it will grow 
without bound if the degree distribution decays exponen- 
tially. In the presence of the peak for hubs, the effective 
exponent will be a non-monotonic function of k. If the 
degree distribution follows asymptotically a power law as 
P{k) ~ k~'^ , the effective exponent will converge to 7. 

In Fig. [51 we present the plot of the effective expo- 
nent at several values of r at p = 1.0. When r — 0.055, 
there appears a plateau at 7e// — 4.3. Above and below 
r = 0.055, the effective exponent plot shows the charac- 
teristic of the exponential decay and the peak for hubs, 
respectively. Hence we conclude that the structural phase 
transition takes place at r = Tc = 0.055(5). The degree 
distribution aX r = follows the power-law decay with 
the exponent 7 ~ 4.3. Note that the blowup of 7e// 
for < 0.02 is due to a finite size effect. Repeating 
this analysis at other values of r and TV, we obtain the 
numerical phase diagram as shown in Fig. [31 Although 
a finite size effect is rather large up to TV = 2000, the 
numerical phase diagram show a clear evidence for the 
phase transition. The degree exponent remains almost 
constant along the phase boundary. 

We present an analytic theory which explains the 
mechanism of the phase transition. In order to describe 
the dynamics, one needs to consider the degrees of all 
nodes, the weights of all edges, and the particle occupa- 
tion number at all nodes. It is difficult to consider the 
whole dynamics, so we develop an approximate theory as 
below. 

Consider an arbitrary node iq. The degree of the node 
at time t will be denoted by K{t). We assume that there 
exists a characteristic value of the weight Vl{t) for the K 
edges of zq- We make a further assumption that the other 
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FIG. 3: Numerical phase diagram obtained from simulations 
with = 1000 and 2000. 



part can be regarded as a uniform medium where edges 
are rewired at a constant rate s. For these assumptions, 
our description is a mean field theory, which works only 
when structural heterogeneity of the system is negligible. 
It is not valid in the heterogeneous phase with hubs since 
it loses self-consistency. Nevertheless, we can learn when 
and why the structural phase transition will occur from 
the breakdown of self-consistency. 

An edge gains a weight when particles arrive at its 
connecting nodes. Diffusing particles on complex net- 
works reach the stationary state very rapidly [ij, . So 
we adopt a quasi-stationary state assumption that the 
particle distribution is approximated by the the station- 
ary state distribution to a given network at each mo- 
ment. The stationary state particle distribution function 
is strictly proportional to the degree 13]. The quasi- 
stationary state assumption, which was also made in 
Ref. [ni ) allows us to integrate out the particle degrees of 
freedom. Then, the rate equation for the weight variable 
f2 in time-continuum limit is given by 
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pK 



(3) 



The first two terms account for the gain coming from the 
visit of particles to the node io and its neighboring node, 
respectively. The last term accounts for the loss due to 
the degradation. 

The degree variable K{t) follows the rate equation 

'^^ ^ (4) 



dt 



1 + n 



The first term accounts for the attachment of a randomly 
rewired edge to io, and the second term accounts for 
the rewiring of each of the K edges with the probabil- 
ity 1/(1 + n). 

The flow governed by Eqs. ^ and ^ has an attracting 
fixed point when r > Vc with 

- IB. 
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FIG. 4; Schematic flow diagram in the {Q,, K) plane when r < 
Tc (a) and r > rc (b). The fixed point (f2o, ifo) is represented 
with a filled circle in (a). 



The fixed point is located at 



s{r + p) {p 



(6) 



Irrespective of an initial condition, the flow converges to 
the fixed point. 

When r < Tc, there does not exist an attracting fixed 
point at finite values of K and O. They grow un- 
boundedly. The blowup solution invalidates the assump- 
tion that the network remains homogeneous. It signals 
the emergence of a hub. The flow pattern is sketched 
schematically in Fig. [H 

The mean field theory confirms that the structural 
phase transition indeed takes place. It also reveals the 
mechanism for the emergence of the hub. Following 
Eq. ([3]), an increase of K accelerates the growth of fi. 
Likewise, an increase of accelerates the growth of K. 
This shows that there is a positive feedback between K 
and n. Actually the edge weight growth is driven by dif- 
fusing particles. Therefore, we conclude that the coupled 
dynamics of the network and diffusing particles can lead 
to the heterogeneous network structure. 

The model displays an interesting scaling behavior in 
the heterogeneous phase. Figure Oa) shows the degree 
distribution at several values of iV to a given value of 
p = 1.0 and r = 0.01 belonging to the heterogeneous 
phase. There is a peak corresponding to the hubs. As 
N increases, the peak shifts to the right but does not 
sharpen nor broaden. This suggests that the number of 
hubs scales algebraically with N and that their degrees 
have the same order of magnitude scaling algebraically 
with N. One can measure the number of hubs N^ub from 
the spectral weight of the peak in P{k). The numerical 
data for Nhub are plotted in Fig. [5Jb) , which shows that 
it follows a power law 



(7) 



with q ~ 0.43. Figure[5I^b) also shows that the maximum 
degree k^ax among all nodes follows a power law 



(8) 



with 9 ~ 0.64. The sum of the exponents is close to unity, 
which indicates that the total number of edges Ktotai 
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FIG. 5: Degree distribution in (a) and khub, Nhub, and Ktotai 
in (b) in the stationary state in systems with p = 1.0 and 
r = 0.01. The straight lines in (b) are guides to eyes. 



attached to the hubs is proportional to N. Numerical 
data in Fig. E^b) shows that 
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(9) 



with fi ~ 1.07 which is very close to 1. The exponents q, 
9, and fi remain constant in heterogeneous phase up to 
statistical errors. 

The structural phase transition has a similarity 
to a condensation transition in the zero range pro- 
cess (ZRP) [l^. In the ZRP, a unit mass hops from 
one site to another on a given graph with a hopping rate 
depending on the total masses on a departing site. The 
masses may undergo a condensation transition between 
a fluid phase and a condensed phase. In the fluid phase, 
masses are distributed uniformly. When there is a strong 
on-site attraction among masses, a quenched disorder, or 
a structural heterogeneity in an underlying graph, a fi- 
nite fraction of the total masses can condense on a single 



site to form a macroscopic condensate [13, [H, [3 [13] ■ 

The similarity between the condensation in the ZRP 
and the emergence of hubs in network dynamics has al- 
ready been noticed in Ref. [18]. Regarding nodes and 
edges in the network dynamics as sites and masses in the 
ZRP, respectively, a hub can be seen as a condensate of 
edges. Apart from the similarity, the structural phase 
transition in our model has a distinct feature. In the 
context of the condensation, there exist multiple number 
of condensates {Nhub ^ iV'^°) and the condensates are 
mesoscopic, that is to say, their size scales sublinearly in 
in N {khub ^ N'^^'^). This is contrasted to the ZRP with 
a local dynamics which has a sin gle macroscopic conden- 
sate in the condensed phase [Tsl. Il6|. 

Recent studies report that multiple mesoscopic con- 
densates appear when the dynamics is nonlocal in the 
sense that the mass hopping rate depends not only on 
the local occupation number but also on the global pa- 
rameter such as the system size [H, [l9|. In our model, 
the edge rewiring dynamics is purely local but coupled 
with the weight dynamics. We leave it as a future work 
to understand the origin for the emergence of multiple 
mesoscopic condensates in the context of the ZRP. 

In summary, we propose a dynamic model for networks 
with the edge rewiring dynamics which is coupled to the 
particle diffusion dynamics. The model displays a struc- 
tural phase transition between the homogeneous phase 
and the inhomogeneous phase. The former is character- 
ized by an exponential degree distribution and the latter 
is characterized by the multiple mesoscopic hubs. Those 
hubs are the consequence of the positive feedback be- 
tween the edge and particle dynamics. Our work uncov- 
ers a mechanism how structural heterogeneity of complex 
networks can emerge. 

This work was supported by Korea Research Council 
of Fundamental Science & Technology. 
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